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ABSTRACT 

This Study compared tvo learning structures for an 
introdudtory course in tests and seasureeents in teres of their 
relative effects on attitudes and achievement* The first structure 
represented a functionally arranged instructional sequence (FAIS) « 
The second represented a psychologically arranged instructionel 
sequence <PAIS)* The instructional sequencing effects were 
investigated in teres of a coepletely-crossed Treatment by Instructor 
by Aptitude design* The four instructors vere eele^ veil* trained in 
eeasureeent^ but vith different degrees of experience in teaching 
this content* The subjects vere 143 female and 14 sale-undergraduate 
eleaentary education sajor3 enrolled in a 16 veek block course* 
Students vere quasi-randosly assigned to treateent groups* Students 
constructed their achievement tests (the performance eeasure) at the 
end of their unit on Measurement llheory* For the FATS group this vas 
near the beginning of the term; for the PAIS groap this vas near the 
end of the term* It the end of the tere post attitude end instructor 
evaluation data vere collected* A final sussetive achievement measore 
on all course objectives vas adsinistered 10 daye later* Under the 
FATS treatment the most experienced instructor got high achievesent 
but negative attitude gains^ vhereas under the PAIS treatment this 
instructor got both high achievement and positive attitude gains* The 
PAI? treatsent produced /Consistent results regardless of instructor 
or level of aptitude* <!tc) 
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THE RELATIVE EFFECTS OF ALTERNATIVE LEARNING 
STRUCTURES ON ATTITUDES AND ACHIEVEMENTS 



James Carifio^ Boston University 



The present study compared two learning structures for an 
introductory course in tests and measurements. The first structure 
represented a functionally arranged instructional sequence (FAIS) 
for this curriculum; the second a psychologically arranged instruc- 
tional sequence (PAIS). Hypotheses were investigated in a Sequence 
by Teacher by Aptitude design (2x4x2) in terms of eleven dependent 
variables- flultivariately, the PAIS treatment proved superior to 
the FAIS treatment. 



Paper presented at the 1976 Annual meeting of the AMTican E<luc«tionftl 
Research Association^ San Francisco^ California* 



Responding to several surveys done on the needs of in-service teachers » 
Mayo (1967) conducted a four*year national study on training programs in 
educational measurement. The results of this four^year study (N&2»877) were 
as follows: 

Although pre*service training programs in educational measure** 
ment wer^ extremely pervasive^ the effectiveness of the types 
of training available was remarkably poor (means of less than 
Sot mastery in almost all of the groups observed). Gains in 
measurement competencies two years after pre-service training 
were also minimal regardless of whether the intervening exper^ 
ience was teachings in-service training, or graduate study. 
It was therefore concluded that tdiile the presence or absence 
of training had some effect on achievement » **whether a person 
had one treatment or another made little practical difference"^ 
in observed measurement competencies (Mayo, 1967; p. 55)." 

With regards to these findings » Mayo speculated that the negative attitudes 
of many students towards tests, evaluation, statistics, and mathematics might 
be iii^ortant factors in their lack of initial or subsequent attainment of 
measurement con^etencies. 

Working independently of Mayo, Goslin (1967) did a cross-sectional 
survey of public, private^ and parochial school teachers (NM,879) concerning 
their uses of and attitudes towards standardized tests. Goslin found that 
40% of the teachers surveyed had minimal knowledges of standardized tests, 
and that there was a moderate correlation (r«i^.44) between teachers' atti- 
tudes towards standardized tests and their amount of training in measurement. 
Goslin also found that teachers' knowledges of and attitudes towards tests 
influenced the types of information they utilized in decision«making as well 
as the quality of educational decisions they made. Like Mayo, Goslin con*^ 
eluded that explicit consideration needed to be given to developing success- 
ful teacher«training programs in educational measurement* 



Purpose of the present Study 

The present study compared two learning structures for an introductory 
course in tests and measurement in terms of their relative effects on atti- 
tudes and achievement. The first of these two learning structures represented 
that instructional sequence most commonly en^loyed for this curriculum as 
established by both the Mayo (1967) study and a more recent textbook survey 
conducted by this writer (CarifiOi 1972). This traditional instructional 
sequence was taken to be representative of a functional learning structure, 
or the common-sense prescription that curriculum content needs only to be 
organised in some plausible developmental order for effective learning to 
occur. The second learning structure used in the present stu<i^ was derived 
by the technique of task analysis (Ga^ne^ 1970) and represented that in- 
structional sequence which may have better maximized positive transfer be- 
tween the knowledge elements of this curriculum. This latter instructional 
sequence was taken to be representative of a psychologically arranged learn- 
ing structure for the content of this curriculum. 



Description of Sequences 

Figure I describes the functionally arranged (i.e., common or typical) 
instructional sequence employed for the measurement curriculum.^ As can be 



Full explication of the theory and background of this topic is not 
possible within the confines of this short paper whose primary goal is to re* 
port the results of the experiment conducted. For a full discussion of this 
topic see Ausubel (1968) on rote versus meaningful instructional sequences^ 
or Gagne (1970) on effective learning structures. In terms of general theo* 
retical perspective^ this writer feels that Ausubel *s vietrt are the most com* 
prehensive in both scope and explanatory power of all t^ose who have written 
on this subject. In terms of concretely applying Ausubel*5 vieirSi tKweveri 
this writer found Gagne^s taxonomy of generalised learning types and tech- 
nique of task analysis to be most helpful in identifying the subordinate- 
stq^erordinate and transfer relationships that were inherent In the subject 
matter to-be*^acquired. 



Figure I 

The Common or Functionally Arranged Instructional Sequence 
for an Introductory Course in Tests and Measurement 



Topic 1 : Measurement Theory (Operational Strategies) 

1.1 Specification of Curriculum Outcomes: learning and behavioral objectives 

1.2 Taxonomies of Educational Objectives: Bloom^s taxonomy of the cognitive 
domain » Krathwohl*s taxonomy of the affective domain 

1.3 Task Analysis and the Planning of Assessment Procedures: universes^ 
domains^ tables of specification^ representativeness^ and san^llng 

1.4 Types of Assessment Procedures; objective^ subjective^ and perfonunce 
measures 

1.5 Measurement Principles Comroon to Different Assessment Procedures; coisptrt^ 
bility^ sampling^ procedures of scorings etc. 

1.6 The Construction and Scoring of Assessment Procedures 



Topic 2 : Descriptive Statistics (Concept Learning) 

2.1 Organizing and Translating Information: codings distributions^ tables^ 
samplings and representativeness 

2.2 Measures of Central Tendency: rnode^ liedian^ mean 

2.3 Measures of Variability: range^ quartiles^ standard deviation^ variance 

2.4 Normal and Skewed Distributions 

2.5 Information Scales and Statistics Appropriate to Th«i; no minal^ ordinal^ 
interval^ and ratio scales 

2.6 Making Elementary Comparisons: standard scores and norms 

2.7 Interpreting Descriptive Statistics; synthesis of concepts and principles 

Topic 3 ; Correlation (First*Order Principle Learning ) 

3.1 Dependent and Independent (functional) Relationships 

3.2 Scatter Plots and Correlation Coefficients 



Figure I (continued) 

3.3 Explained and Unexplained Variance 

3.4 Rrediction and Regression 

3.5 Interpreting Correlation Coefficients 

Topic 4 ; Reliability; Stability, Comparability, Consistency (Second*Order 
Principle Learning) 

4.1 Definitions of and Relationships between Reliability and Validity 

4.2 Error Theory, Sources of Error, and the Standard Error of Measurement 

4.3 External Determinations of Reliability: test-retest, equivalent forms 

4.4 Internal Determinations of Reliability: split-halves, odd-even, internal 
consistency 

4.5 Interpretations of and Relationships between Reliability Estimates 

Topic 5 : Validity: Interpretability and Meaningfulness (Third-Order 
Principle Learning) 

5.1 The Concept of Differential Evidence 

5.2 Face Validity 

5.3 Content Validity: expert, curricula 

5.4 Predictive Validity 

5.5 Construct Validity: convergent, discriminant, cross-^ Validation 

5.6 Interpretations of and Relationships between Different Kinds of Validity 

5.7 Types of Measures and the Validities They Should Have 

5.8 Instrument Revision Based on En^irical Data 
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seen from Figure I, the common instructional sequence seems to reflect the 

series of steps one goes through in developing a measuring instrument.^ 

This is to say« first one constructs a test (Measurement Theory)^ then one 

collects some data on the test constructed (Oescriptive Statistics) « and 

then one determines the quality of both the instrument and information col- 

lected (Correlation^ Reliability^ and Validity). In this sense^ the common 

instructional sequence seems to be both ^'logical** and highly ^'plausible.*' 

A learner- centered task analysis of this curriculum^ however^ presents a 

somewhat different picture. 

When one begins to task analyze Measurement Theory (the first topic in 

the common instructional sequence) to determine its subordinate knowledge 

elements or relevant anchoring ideas^ one begins to realize how heavily the 

topic relies on the concepts and principles of descriptive statisti^s^ cor* 

2 

re'?>tj.on, reliability^ and validity. Reliability and validity are reflected 
throughout the content of Measurement Theory as are the principles of dis- 
tributiveness^ samplings and correlation. The cominon instructional sequence^ 
then« begins by requiring students to acquire new and conplex ideas which 
are based on other ideas (concepts and principles) they have not yet acquired. 
This beginning not only creates a rote learning situation^ but it also dras^ 
tically diminishes the affective impact of jthis content (which is the most 



No rationale has ever been stated for this instructional sequence 
to the best of this wri^er^s knowledge. 

2 

In addition to Gagne*s question of *^at must the learner be able 
to do to acquire this competency/* this writer also kept asking the Autuballlm 
question of '*What must the learner know to understand the ratlimale b^ind^ thd 
neaningfulness in^ and value of this particular learning** thivnighout the course 
of analysis. It was from a continual answering of this second <^stion that the 
alternative instructional sequence emrged^ 



controversial of the units in this curriculum) upon the learner (see 
Ausubel and Fitsgerald^ 1963). 

If one used Gagne's taxonomy or Ausubel's notions of meaningful 
learning as a guide^ one would make Measurement Theory the last unit in 
this curriculum with the other topics retaining their original ordering 
(see Figure 11).^ Such an ordering of the content units of this curriculum 
would create most of the properties of an effective learning structure that 
are typically cited in the literature on this subject (see Ausubel^ 1968; 
Briggs^ 1968; Heimer^ 1968; Gagne> 1970). The net effects of these proper- 
ties should produce better overall achievement in the various competencies 
of this discipline in the psychologically arranged instructional sequence. 
The differential effects of encountering Measurement Theory last Ci*e.> 
after learning the concepts and principles of the discipline) should produce 
better attitude changes in the learner dtiO to better cognitive readiness to 
evaluate the soundness of the subject-matter content^ rationales^ and argu- 
ments encountered at that point in time. Since Mayo (1967) cited attitude^ 
towards tests^ evaluation^ and mathemntics as being potentially critical 
factors in terms of this curriculum^ these were the specific attitudes that 
were focused upon in this study. 



Instructional sequencing effects were investigated in the present study 
in terms of a completely-crossed Treatment (Sequence) by Instructor by Apti* 
tude (high-low) design (2x4x2). The four instructors were iiale^ well-trained 



Subtopics were vertically arranged to maximize transfer and held 
constant in both sequences in the present study; only the between topics 
structure was varied. 




figure II 

The Alternative Learning Structures Used for the 
Introductory Tests and Measurement Curriculum 



Functionally Arranged Sequence 
Topic 1: Measurement Theory (OS) 
Topic 2: Descriptive Statistics (C) 
Topic 3; Correlation (Ist order P) 
Topic 4: Reliability C2nd order P) 
Topic 5; Validity (Srd order P) 



Psychologically Arranged Sequence 
Descriptive Statistics (C) 
Correlation (Ist order P) 
Reliability C2nd order P) 
Validity (Srd order P) 
Measurement Theory (OS) 



C V Concept learning 
P ■ Principle learning 
OS ■ Operational strategies 



in measurementi but vdth different degrees of experience in teaching this 
content (novice to expert). Prior to the experi»ent| the two novice in- 
structors (instructors 1 and 2 in all tables) favored the functionally ar* 
ranged instructional sequence (PAIS), while the two experienced instructors 
(Instructors 3 and 4 in all tables) favored the psychologically arranged 
instructional sequence (PAIS). Subjects were 157 undergraduate elementary 
education majors enrolled in a 16*waek block course at Boston University in 
Semester I, 1972. The sample was comprised of 143 females and 14 male sub* 
jects. Mayo (1967) found no sex differences in the learning of measureaent. 

The dependent variables that were investigated in the present study are 
given in Table I. As can be seen from Table I, five achleveMnt variables^ 
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Table I 

List of Dependent Variables Investigated 



MT « Achievement in Measurement Theory 

STAT « Achievement in Descriptive Statistics 

CORK » Achievement in Correlation 

RELI « Achievement in Reliability 

VALI « Achievement in Validity 

TCON ^ Standardized performance measure of student *s ability to 
construct a classroom achievement test 

CDAT » Cognitive Dimension of Attitude Towards Tests 

ADAT « Affective Dimension of Attitude Towards Tests 

CDAE = Cognitive Dimension of Attitude Towards Evaluation 

ADAE » Affective Dimension of Attitude Towards Evaluation 

CDAM <* Cognitive Dimension of Attitude Towards Mathematics 



one performance variable and three attitude variables were investigated* The 
attitude measures used in the present study were semantic differentials devel* 
oped specifically to reflect Peak^s C19SS) two factor theory of attitude 
(cognitive and affective dimensions)* Table II gives the factor structure of 
the semantic differential used to measure attitude towards tests*^ The saae 
bipolar pairs as given in Table II were used to measure attitude towards eval* 
uation with the same type of factor structure resulting. McCallon^s (1972) ATM 



All factor analyses reported in this paper are principle component 
solutions with varimax rotations. 

io 



Table II 

Factor Structure of Attitude 
Towards Tests Semantic Differential 



PAIR 


I 


II 


. 2 
h 


neaningfUl: meaningless 


.79 


.34 


.73 


concealing: revealing 


.74 


.28 


.63 


necessary: unnecessary 


.81 


.18 


.69 


useful : useless 


.82 


.34 


.79 


oppressive: liberating 


.38 


.65 


.56 


effective: ineffective 


.78 


.36 


.74 


boring: interesting 


.28 


J58 


.53 


beneficial: harmful 


.70 


.38 


.63 


frustrating: stimulating 


.23 


.77 


.63 


valuable: worthless 


.81 


.29 


.75 


pieasani : unpieasani 


* 


* f o 


* 0/ 


sinister: intriguing 


.25 


.75 


.50 


important: unimportant 


.81 


.29 


.74 

* 


repugnant: likable 


.24 


.80 


.70 


needed: unneeded 


.75 


.33 


.67 


helpful: hindering 


.72 


.40 


*• 


satisfying: unsatisfying 


.48 


.57 


.55 


N » 477 


40% 


26% 


66% 


I « Cognitive Dimension 


II - 


Affective Diaension 
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semantic differential was used to measure attitude towards mathematics. This 
scale reduced to one factor (the cognitive dimension) for the experimental 
group used in the present study» thus the missing dimension on this measure, 
A siii|>le sum of the scores divided by the number of items constituting the 
factor procedure was used to score the semantic differential data collected 
(see Dagenais and Marascuilo, 1973) , 

The classroom achievement test each student constructed (the perform- 
ance measure) was blind-scored by two instructors using a S6 judgement anal- 
ytical rating scale* The average score of the two judges was used as the 
score on this variable for the student. Table III presents the reliability 
data on the dependent variables investigated in the present study and Table IV 
presents the factor structure of these variables. 

Twelfth-grade grade math and verbal SAT scores were used as estimates 
of aptitude. The median combined SAT score (993) was used to divide the 
sample into higlt and low aptitude scores. Pre-treatment attitude scores were 
gathered one week prior to treatment as part of a larger data gatherj<^3 pack* 
age for the entire block course. Students were told that all data collected 
would be used for block planning and evaluation puirposes* This practice had 
been in use for two semesters prior to this experiment* 

Students were assigned to treatments in a quasi-random manner; i*e*» 
students with automobiles for field experience were randomly assigned to 
groups first and then the remainder of students were randomly assigned* This 
procedure was checked with the pre-treatment data available (attitude and 
SAT scores) and the groups were found to be equivalent* Treatments were ad* 
ninistered to group? according to a counter-balanced timing schedule; na»ely» 
each group did not receive treatment at the same time of day or in the sane 
room over the course of the semester, nor did any one group* At the end of 

12 
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Table III 

Reliability Coefficients for Dependent Variables 



Variable 


n 

a 




Alpha 






TM 


J f X 


1 5 


Aft 




AA 


STAT 


371 


17 


.66 


62 


.91 


COR 


371 


13 


.69 


62 


.93 


RELI 


371 


10 - 


.S2 


62 


.89 


VAil 


371 


13 


.S5 


62 


.90 


TCON 


SO 


56 


.79 


SO 


.87* 


CDAT 


377 


10 


.89 


54 


.91 


ADAT 


377 


7 


.81 


S4 


.87 


CDAE 


377 


10 


.88 


S4 


.90 


ADAE 


377 


7 


.76 


54 


.84 


CDAM 


377 


13 


.88 


54 


.94 



k » number of items ^ 
Alpha » coefficient alpha 

^tt * test-retest reliability coefficient (14 day interval) 

* « inter-rater reliability coefficient for 4 raters on a 
sample of 50 student test constructions 



each instructional unit^ students were given a criterion-re fermced nastery 
test on the unit studied*^ Review was given to students who did not reach 
criterion* Modular self-instructional Mterial and practice exercises on 
each unit were distributed to each student at the beginning of each unit to 
be used as supplements to (or replacements of) the classroom instruction* 

^ Different forms of the same set of mastery tests wer# used in etch ' 
sequence* ^ o 



Table IV 

Factor Structure of Dependent Variables 



Variable 


I 


II 


III 


IV 


V 


VI 




WVTH APT 


57 


03 


-16 


ss 


16 


-30 


77 


VERBAL APT 


62. 


.08 


-16 


18 


13 


-39 


69 


PRE CDAT 


07 


77 


10 


18 


-16 


01 


67 


PRE ADAT 


03 


76 


06 


17 


-04 


-04 


61 


PRE CDAE 


-02 


03 


87 


05 


' 21 


-08 


82 


PRE ADAE 


02 


-02 


86 


-03 


28 


-01 


8i 


PRE CDAM 


14 


18 


, 04 


89 


-02 


06 


84 


POST CDAT 


13 


78 


-04 


01 


29 


01 


71 


POST ADAT 


13 


81^ 


-10 


09 


23 


-07 


75 


POST CDAE 


00 


09 


23 


06 


83 • 


-05 


76 


POST ADAE 


-04 


09 


25 


05 


80 


04 


72 


POST CDAM 


15 


30 


03 


78 


12 


05 


74 


MT 


71 


12 


22 


06 


-15 


00 


59 


STAT 


68 


08 


06 


29 


01 


22 


60 


COR 


75 


13 


-21 


-03 


14 


14 


66 


RELI 


70 


05 


08 


18 


-15 


-01 


56 


VALI 


81 


11 


-05 


-02 


OX 


09 


67 


TCON 


14 


-10 ' 


-12 


06 


01 


86 


79 


Percentages 


19.8 


14.8 


10.1 


10.8 


9.6 


6.1 


71 



of total 
variance 
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Students constructed their achievement tests (the performance measure) 
It the end of their unit on Measurement Theory. For the PAIS group^ this 
was near the beginning of term; for the PAIS group^ this was near the end of 
term* At the end of term (IS weeks) « post attitude data were collected^ as 
well as instructor evaluation data (responded to anonymously) using an amended 
version of the Hildebrand (1972) scale (a sixth subscale dealing with assess* 
ment and evaluation was added) * Ten days later^ the final summative achieve* 
ment measure (6S multiple* choice items) on all course objectiires was adminis* 
tered* None of the treatment groups had previously seen any of the items on 
this measure* 

Results 

Table V presents the results of a Sequence by Instructor by Aptitude 

(2x4x2) multivariate analysis of vai*iance (MANOVA) done on the pre*treatment 

attitude data collected in the present study* ^ As can be sam from Table V« 

significant pre-treatment differences were found between high and low apti* 

tude students on the affective dimension of attitude towards tests and on the 

cognitive dimension of attitude towards mathematics* Table VI presents the 

means and standard deviations of high and low aptitude students on the pre* 

treatment attitude data collected in the present study* If Table VI is ax^ 

amined in relationship to Table V and the factor analjrtical information given 

in Table IV, the following findings should become mmifast: 

(1) Students* attitudes towards tests are Independent of their 
attitudes towards evaluation^ but slightly correlated to their 
attitudes towards mathematics (see Table IV)* This is a find* 
ing that has been cross^validated by this writer in a larger 



All multivariate analyses were done with the University of Buffalo 
HANOVAC program; cell means are reported at the end of this, papers 



Table V 



Results Matrix for a Sequence by Instructor by Aptitude (2x4x2) 
MANOVA of Pre-Treatment Attitude Scores 



Variable 


Sequence 


Instructor 


Aptitude 


Sxl 


SxA 


IxA 


SxIxA 


Pre CDAT 


NS 


NS 


NS 


NS 


NS 


NS 


NS 


Pre ADAT 


MS 


NS 


* 


NS 


NS 


NS 


NS 


Pre CDAE 


NS 


NS 


NS 


NS 


NS 


NS 


NS 


Pre ADAE 


NS 


NS 


NS 


NS 


NS 


NS 


NS 


Pre CDAM 


NS 


NS 


** 


NS 


NS 


NS 


NS 


Multivariate F 


NS 


NS 


«* 


NS 


NS 


NS 


NS 






p<.05 ** 


« p<.01 











Table Vi 

Pre-Treatment Attitude Means for High and Low Aptitude Students 



CDAT ADAT CDAE ADAE - CDAM 

ji_ X s X $ X s X s X s 

High Apt. 77 4.2 1.0 3.3 0.7 S.6 0.6 4.6 0.6 4.7 0.9 

Low Apt. 79 4.1 1.1 3.0 0.8 5.6 0.7 4.6 0.6 3.7 0.9 
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CN^377) and more heterogeneous saiig[>le of people than those in 
this study^ and it is not a finding that one would ^Uogically** 
expect in terms of these attitudes; 

(2) Students of high aptitude tend to enter rhe instructional situa* 
tion in this subject matter with a very positive attitude towards 
evaluation « a somewhat negative attitude towards tests « and a 
somewhat positive attitude towards math^atics (see Table VI); 

(3) Students of low aptitude tend to enter the instructional situa* 
tion in this subject matter with a negative attitude towards 
tests^ a positive attitude towards evaluation^ and a negative 
attitude towards mathematics (see Table VI); 

(4) Tests are a potent affective stimulus to students entering the 
instructional situation in this subject matter area (see Table VI); 

(5) Both attitude towards tests and attitude towards mathematics are 
significantly related to achievement in this subject matter 
content (see Table IV and Table X). 

The above findings would seem to (a) confirm Mayors speculations about 
the existence and possible in^ortance of attitudinal factors in the acquisi- 
tion of this subject matter content (with the exception of attitude towards 
evaluation) J and (b) suggest the possible importance of attending to affective 
factors in designing effective instructional programs (i.e.j instructional 
sequences) . ^ 

A Sequence by Instructor (2x4) multivariate analysis of variance was 
computed on the six subscales of the post -treatment teacher evaluation data 
collected in the present study. A significant treatment by instructor inter- 
action was found with instructor 1 (least experience in teaching this con* 
tent) being rated significantly hij^er in the PAIS treatment and significantly ^ 
lower in the PAIS treatment than the other three instructors on all six sub* 
scales. The between- treatments and between -in struct or ratings for the other 
three instructors were not significantly different from each other on any of 
the six subscales examined and the ratings of alKlnstructors on all subscalui: / 
were above 5.0 on a 7.0 scale. 'These results mL0it be interpreted in won \/ 
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than one way> but this writer interprets them as being confirmatory of the 
hypothesiJ^ that these instructors delivered high quality teaching in both 
instructional sequences and did not consciously do anything to bias the re-* 
suits of this experiment. 

Table VII presents the results of a Sequence by Instructor by Aptitude 
(2x4x2) niultivariate analysis of covariance done on the eleven dependent var- 
iables investigated in the present study (see Table I) using the five pre- 
treatment attitude measures as covariates. As can he seen from Table VII» 
the PAIS treatment produced siqperior results to the PAIS treatment at the 
.001 level on all of the dependent variables investigated except the cogni* 
tive and affective dimensions of attitude towards evaluation. Selected in- 
structor differences were observed at the .001 level on five of the eleven 
dependent variables investigated. It is inqportant to note in interpreting 
the results of the aptitude factor in Table VII that no significant post-^ 
treatment aptitude differences were observed in terms of the affective dimen- 
sion of attitude towards tests or the cognitive dimension of attitude towards 
mathematics. The reason for thijs lack of differences may be best understood 
by examining the average attitude change scores (see Richards^ 1975) given in 
Table VIII. 

As can be seen from Table VIII » low aptitude students in the PAIS 
treatment became significantly more negative on the affective dimensions of 
attitudes towards tests and evaluation^ while low aptitude students in the 
PAIS treatment became itore positive in all attitudes at a tate equal to high 
aptitude students in the PAIS treatment and greater than high aptitude students 
in the PAIS treatment.^ In fact» the overall profile of low aptitude students 

^ All students* attitudes on the cognitive diarnisioii of attitude towards 
tests became significantly more positive^ but this outcome was to be expected 
ftom Goslin's findings reviewed in the introduction of this ptperv 



Table VII 

Results Matrix for Sequence by Instructor by Aptitude (2x4x2) 
MANCOVA on the Eleven Dependent Variables Investigated 
in the Present Study Using the Five Pre-Treatment 
Attitude Measures as Covariates 



Variable 


Sequence 


Instructor 


Aptitude 


Sxl 


SxA 


IxA 


SxIxA 


TTH 




* 


*** 


NS 


NS 


NS 


NS 


STAT 


*** 


*** 


*** 


NS 


NS 


NS 


NS 


CORK 


*** 


NS 


*** 


NS 


NS 


NS 


NS 






no 


*** 


MC 

no 


no 


MC 

no 


MC 

no 


VALI 


*** 


* 




NS 


NS 




NS 


TCON 




NS 


NS 


NS 


NS 


NS 


NS 


CDAT 


*** 


*** 


NS 


* 


NS 


NS 


NS 


ADAT 




* 


NS 


NS 


NS 


NS 


NS 


CDAE 


NS 


NS 


* 


NS 


NS 


NS 


NS 


ADAE 


NS 


NS 


NS 


NS 


NS 


NS 


NS 


CDAM 


** 


NS 


NS 


NS 


NS 


NS 


NS 


Multi- 
variate 


*** 

F 


*** 


*** 


NS 


NS 


NS 


NS 




* 


K p<.05 


** = p<.01 


* 


» p<.001 







All results in expected direction; i.e., PAIS greater than PAIS 



in the PAIS treatment given in Table VIII more closely resembles the overall 
profile of high aptitude students in the PAIS treatment than low aptitude 
students in the PAIS treatment.^ This consistency of effects of the PAIS 
treatment is its distinguishing characteristic as may be observed from Tables 
IX and X, 

Although several treatment by aptitude interactions approached signifi^ 
cance (.10 level) none were actually observed in any of the analyses done. 
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Table VIII 



Comparisons of Post -Treatment Means 
or Gains on Dependent Variables 



PAIS 



PAIS 



APT 


n 


CDAT 


ADAT 


CDAE 


ADAE 


CDAM 


HIGH 


39 


.76* 


.23 


.43 


.10 


-.07 


LOW 


39 


.59 


-.41 


..89 


-.87 


-.15 


HIGH 


38 


1.3 


,73 


.40 


.18 


.11 


LOW 


40 


1.4 


.68 


.27 


.47 


,51 



* Average point change in attitude from pretest on a 1 to 7 scale. 



PAIS 



PAIS 



APT 


n 




STAT 


CORK 


RELI 


VALI 


TCON 


HIGH 


39 


66** 


70 


77 


65 


66 


83 


LOW 


39 


52 


55 


63 


49 


55 


83 


HIGH 


38 


72 


77 


85 


71 


72 


88 


LOW 


40 


61 


68 


75 


57- 


64 


87 



** Percentage of total itms answered correctly. 



As can be seen from Table IX, the differences between treatments are 

greater for the inexperienced instructors than for the experienced instructors* 

« 

Under the PAIS treatment, instructor effects are quite variable, whereas under 

the PAIS treatment the instructor effects are fairly homogeneous*^ This pat- 
tern of instructor effects was observed across all of the dependent variables 



In this sense> the PAIS may be said to reduce or compensate for 
teacher effects* 
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Table IX 



Sequence by Instructor by Aptitude (2x4x2) Analysis of Variance 
on Total Post -Treatment Achievement Scores 



PAIS PAIS 





n_ 


Hi Apt 


H 


Lo Apt 


n 


Hi Apt 


n_ 


Lo Apt 


^1 


9 


42.2 . 


9 


33.3 


9 


48.6 


10 


40.8 


h 


10 


43.9 


10 


34.2 


10 


49.2 


10 


41^3 


h 


10 


45.7 


10 


37.6 


10 


49.3 


10 


43.5 


h 


10 


48.1 


10 


39.4 


10 


49.5 


10 


44.5 



39 45,1 


39 


36.2 39 


49.2 40 


42. 


Source 




MS 


F 


P 


Sequence 


1 


1063.1 


25.6 


<.001 


Instructor 


3 


132.7 


3.2 


<.03 


Apt Itude 


1 


237.4 


57.3 


<.001 


Sxl 


3 


24.2 


0.6 


>.05 


SxA 


1 


46.3 


1.1 


>.05 


IxA 


3 


11.2 


0.3 


>.05 


SxIxA 


3 


3.0 


0.1 ; 


>.05 


Error 


140 


41.5 







21 

-19- 



Table X 



Correlations Between Aptitude, 
Pre-Attitude and Post -Achievement Scores 



PAIS 



TTH 


MSAT 

43 


VSAT 
40 


CDAT 


ADAT 

■id 


CDAB 
■ 01 


ADAE 
■ 11 


CDAM 

3i 


STAT 


51 


34 


18 


20 


03 


09 


43 


CORR 


48 


48 


26 


23 


02 


-09 


19 


RBLI 


46 


43 


19 


14 


07 


05 


39 


VALI 


46 


37 


19 


11 


-12 


-08 


40 


TOTA 


60 


51 


28 


23 


00 


02 


40 


TCON 


-08 


02 
r = 


01 

.17 


-04 
p<,05 


02 


02 


03 








PAIS 










MSAT 


VSAT 


CDAT 


ADAT 


CDAB 


ADAB 


CDAM 


TTH 


28 


42 


-04 


11 


04 


16 


21 


STAT 


44 


27 


06 


10 


03 


13 


33 


CORR 


28 


24 


00 


03 


-28 


-20 


13 


RBLI 


37 


27 


04 


-11 


-03 


-01 


23 


VALI 


35 


33 


-02 


-07 


03 


08 


15 


TOTA 


50 


■ 44, 


01 


00 


-05 


05 


31 


TCON 


13 


-07 


-09 


01 


-17 


-06 


10 



r = .17 p<.05 



investigated. Under the PAIS treatment* the most experienced instructor 
got high achievement but negative attitude gains* whereas under the PAIS 
treatment this instructor got both high achievement and positive attitude 
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gains (see cell means at the end of this paper). The PAIS treatment pro*^ 
duced consistent results (higher achievement and positive attitude changes) 
regardless of instructor or level of aptitude. This consistency of effects 
is what most distinguished the PAIS treatment from the PAIS treatment, as 
can be seen from Tables IX and X, 

Discussion 

The results of the present study would seem to be fairly clear In terms 
of whether or not "functional" or "common sense" notions of subject-matter 
structure or instructional sequencing are sufficient for designing effective 
curricula or instructional programs in all situations. The results of the 
present study would also seem to be fairly clear in terms of the possible 
affective importance of instructional sequencing In many situations. This 
is to say^ the learning of B might be placed before the learning of A for 
"meaningfulness" or affective reasons rather than for "prerequisite'* learning 
reasons. There are a number of instructional situations where this point 
would seem to apply^ which is to say no more than that the operations and 
effects of any given instructional sequence should be carefully analyzed 
and thought about in terms of what is known about learning in the broadest 
sense of the term. Thinking about instruction or instructional sequencing 
from a behaviorist or neobehaviorist point of view leads one logically to 
the position that all learnings are essentially of equal unit value as are 
all learning experiences. The results of the present study would seem to 
suggest that such a theoretical view does not adequately capture the phen^ 
omena in question, and that Ausubel^s notions of meaningfulness and cognitive 
view of learning need to be Integrated into the models of Instruction pres- 
ently available* In many respects, however, the results of the present study 
are not that clear and are in need of replication, 
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Kingsley and Stelzer (1973) have written quite cogently on the context 
conditioned nature of all subject-matter learning and instructional situations. 
In Kingsley and Stelzer*s view^ one cannot generalize^ about subject-matter 
learning qua subject-matter learning because the nature of vhat is learned 
is relative to the objectives of the specific learning situation in question. 
Change the nature of the instructional objectives and the nature of the in- 
structional problem might change quite drastically. The present writer not 
only holds the Kingsley and Stelzer view to be correct but also feels that 
it is particularly true of the instructional sequencing question. This is 
to say, there seems to be a set of conditions (if one carefully reviews the 
literature on this subject) under which instructional sequencing can be ex- 
pected to effect instructional outcomes, and the importance of sequence as 
an instructional variable seems to be relative to these condition. These 
conditions as identified from tl\e literature seem to be: 

(1) that the subject matter to-be-leamed is complex, difficult, 
and unfamiliar to the learner (Tobias, 1971); 

(2) that there is a high degree of inter dependency or relatedness 
between the knowledge elements (concepts, principles, ideas, or 
operational strategies) of the subject matter to-be-acquired 
(Gagne, 196S; Ausubel, 1968); 

(3) that the subject matt^ to-be-leamed has an a priori potential 
for being structured (i-e-, temporally arranged) in terms of its 
own internal logic, subsuming ideas^ cognitive anchors, or needed 
or facilitory "prerequisite learning*' (Briggs, 1968); 

(4) that the subject matter to-be-leamed is controversial and in con- 
flict with the leaner*s attitudinal bias (Ausubel and Pitsgerald^ 
1961); 

(5) that the learner lacks certain characteristics (e.g., Kigh aptitude, 
special abilities, or various nathemagenic behaviors) which facili- 
tate the learning desired independent of any particular kind or 
typo of instruction or learning structure (Ausubel^ 1968; Rothkopf, 
1970; and Salomon, 1973); and, 

(6) that the duration of instruction is sufficient for structuring 
effects to manifest themselves (Roe, 1961), 
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Under the above set of instructional condition, "equally plausible" 
modes of subject-mttcr organisation will not have equal effects as the pres- 
ent study has demonstrated in terms of the ^^experimental instance.*' In terms 
of exactly specifying what PAIxS treatments will be like for different subject 
matter areas and instructional problems^ this writer feels that we are no 
closer to the algorithm Heimer (1969) desires than previously^ and that the 
derivation of PAIS treatments will still be a matter of astute learner- 
centered analysis of both the subject-matter content and the instructional 
situation in question until we better conceptualize both instructional se- 
quencing and instructional systems. In the end^ however^ it may turn out 
that instructional theory is no more than a methodology for analyzing in- 
structional situations and problems in terms of what is known about learn*^ 
ing and its facilitation. If this latter point is true^ then we will need 
a construct called the conditions of instruction if only to bound our models 
and theorizing about this protean phenomena. 
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Table XI 

PAIS Treatment Cell Means on Attitude Variables 



PRE-TREABffiNT 





n 


CDAT 


ADAT 


CDAE 


ADAE 


CDAM 


High Apt 


9 


4.1 


3.2 


5.6 


4.8 


4.8 


Low Apt 


9 


4.0 


2.9 


5.7 


4.7 


3.6 


High Apt 


10 


4.4 


3.3 


5.6 


4.6 


5.0 


Low Apt 


10 


3.8 


2.8 


5.6 


4.7 


4.0 


High Apt 


10 


4.4 


5.5 


4.5 


4.5 


4.5 


Low Apt 


10 


4.1 


3.2 


5.6 


4.5 


3.9 


High Apt 


10 


4.0 


3.3 


5.2 


4.5 


4.4 


Low Apt 


10 


4.1 


3.2 


5.6 


4.6 


4.0 






POST-TREATMENT 










n 


CDAT 


ADAT 


CDAE 


ADAE 


CDAM 


High Apt 


9 


5.1 


3.5 


6.2 


4.8 


4.9 


Low Apt 


9 


" 4.7 


2.8 


5.8 


4.5 


3.6 


High Apt 


10 


5.2 


3.6 


6.0 


4.7 


4.8 


Low Apt 


10 


4.6 


3.0 


5.6 


4.6 


4.0 


High Apt 


10 


5.5 


3.9 


6.0 


4:8 


4.4 


Low Apt 


10 


4.9 


3.3 


6.0 


4.4 


.",9 


High Apt 


10 


4.2 


3.1 


5.4 


4.2 


4.5 


low Apt 


10 


4.2 


2.8 


5.5 


4.S 


3.9 



I 



1 



4 



Table XII 

PAIS Treatment Cell Means for Achievement Variables 





n 


I in 


WAT 






VAI T 


High Apt 


9 


1.9 


1 A 1 

10.1 


1 A 1 

10. 1 


6.5 


7.8 


Low Apt 


9 


6,1 


7.6 


7.6 


5.1 


6.9 


High Apt 


10 


7.3 


12. S 


9.8 


6.2 


8.1 


Low Apt 


10 


S.8 


9.0 


7.7 


4.7 


7.0 


High Apt 


10 


8.2 


12.0 


9.9 


6.1 


9.5 


Low Apt 


10 


6.8 


10.0 


8.5 


4.7 


7.6 


High Apt 


10 


6.7 


10.9 


9.0 


5.3 


7.5 


Low Apt 


10 


6.7 


10.9 


9.0 


5.3 


7.5 





n 


TOTA 


TCON 


High Apt 


9 


42.4 


85.2 


Low Apt 


9 


33.3 


82.2 


High Apt 


10 


43.9 


79.5 


Low Apt 


10 


34.2 


82.9 


High Apt 


10 


45.7 


84.5 


Low Apt 


10 


37.6; 


84.4 


High Apt 


10 


48.1 


82.6 


Low Apt 


10 


39.4 


83.3 
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Table XIII 

PAIS Treatment Cell Means on Attitudes Variables 







PRE-TREABtENT 










n 




A HAT 


CUAs 


ADAb 


CUAM 


High Apt 


9 


4.1 


3.3 


5.8 


4.6 


4.9 


Low Apt 


10 


4.0 

• 


2.9 


5.6 


4.6 


3.4 


High Apt 


'9 


4.3 


3.1 


5.2 


4.6 


4.9 


Low ^t 

i 


10 


4.1 


3.0 


5.3 


4.5 


3.7 


High Apt 


10 


4.0 


3.S 


5.7 


4.6 


4.6 


Low Apt 


10 


4.3 


3.2 


5.6 


4,6 


3.9 


High ^t 


10 


4.3 


3.2 


5.6 


4.5 


4.7 


Low ^t 


10 


3.8 


2.9 


6.0 


4.7 


3.5 



POST-TREABENT 





n 


CDAT 


ADAT 


CDAE 


ADAE 


CDAM 


High Apt 


9 


5.0 


3.6 


6.3 


4.8 


4.9 


Low ^t 


10 


5.3 


3.4 


5.7 


4.7 


4.9 


High Apt • 


9 


5.5 


4.2 


5.8 


4.7 


5.1 


Low Apt 


10 


5.5 


3.7 


5.8 


4.7 


4.2 


High ^t 


It) 


5.9 


4.4 


5.9 




4.7 


Low A^t 


10 


5.6 


4.0 


5.9 


4.6 


4^5 


High ^t 


10 


5.4 


3.9 


6a 


4.9 


4; 8 


Low ^t 


10 


5.1 


3.7 


6^0 


4.8 


4.2 
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Table XIV 

PAIS Treatment Cell Means on Achievement Variables 







TH 


STAT 


CORK 


RELI 


VALI 


High Apt 


9 


8.7 


12.8 


11.3 


6.4 


9.4 


Low Apt 


io 


7.1 


10.5 


9.7 


5.6 


7.9 


High Apt 


9 


7.7 


13.5 


11.2 


7.3 


9.4 


Low Apt 


10 


7.0 


11.4 


9.6 


5.4 


7.6 


High Apt 


10 


9.1 


12.6 


10.9 


6.8 


9.9 


Low Apt 


10 


7.S 


11.4 


9.9 


5.8 


8.8 


High Apt 


10 


8.8 


13.5 


10.4 


7.7 


9.1 


Low Apt 


10 


7.7 


12.6 


9.6 


5.8 


8.9 







TOTS 


TCON 


High Apt 


9 


48.7 


85.5 


Low Apt 


10 


40.8 


85.1 


High Apt 


9 


49.2 


91.8 


Low Apt 


10 


41.0 


87.6 


High Apt 


10 


49.3 


87.1 


Low Apt 


10 


43.5 


86.6 


High Apt 


10 


49.5 


87.6 


low Apt 


10 


44.5 


89.3 
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